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Title:  Controlled  Diffusion  Approximations  for  Controlled  Queueing  Systems 

ABSTRACT 

Four  problem  areas  were  studied.  These  are  (1)  controlled  heavy 
traffic  queueing  systems,  (2)  queueing  systems  with  due  dates,  (3) 
backward-forward  stochastic  differential  equations,  and  (4)  Ginzburg- 
Landau  equations  and  evolving  interfaces.  In  areas  (1)  and  (2),  dif¬ 
fusion  approximations  were  obtained  for  queues  in  heavy  traffic.  In 
(3),  connections  were  established  between  quasi-linear  partial  dif¬ 
ferential  equations  and  diffusion  processes  constructed  via  a  new 
class  of  stochastic  differential  equations.  Finally,  (4)  provides  a 
study  of  the  partial  differential  equation  characterizing  vortices  in 
superconducting  material  in  three  dimensions. 


Principal  Investigators:  Steven  E.  Shreve  and  H.  M.  Soner 
Participating  personnel: 

Steven  E.  Shreve,  Professor  of  Mathematics,  Carnegie  Mellon  University,  Pitts¬ 
burgh,  PA  15213; 

H.  Mete  Soner,  Professor  of  Mathematics,  Carnegie  Mellon  University,  Pitts¬ 
burgh,  PA  15213; 

Bogdan  Doytchinov,  Ph.D.  candidate  and  post-doctoral  researcher,  Depart¬ 
ment  of  Mathematics,  Carnegie  Mellon  University,  Pittsburgh,  PA  15213. 

During  the  period  of  funding,  B.  Doytchinov  earned  a  Ph.D.  in  mathematics. 

This  grant  supported  work  on  four  different  projects: 

I.  Controlled  heavy  traffic  queueing  systems 

2.  Queueing  systems  with  due  dates 

3.  Backward-forward  stochastic  differential  equations 

4.  Ginzburg-Landau  equations  and  evolving  interfaces. 

Queueing  systems  are  highly  complex  and  not  amenable  to  detailed  analysis. 
It  is  nonetheless  desirable  to  have  quantitative  measures  of  the  performance 
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which  one  can  expect  from  these  systems  under  heavy  traffic  conditions.  A 
very  successful  approach  to  this  problem  has  been  to  approximate  the  queueing 
system  by  a  Brownian  network,  a  special  case  of  a  multi-dimensional  diffusion 
process. 

While  Brownian  network  approximations  are  well  understood  and  provide 
accurate  performance  evaluation  results  for  uncontrolled  queueing  systems,  the 
connections  between  Brownian  networks  and  the  underlying  queueing  systems 
are  much  less  well  understood  when  the  possibility  of  control  of  the  queue  is 
allowed.  The  first  project  was  to  develop  this  relationship  at  a  mathematically 
rigorous  level  for  a  representative  queueing  system.  This  resulted  in  (1). 

Brownian  networks  normally  model  the  number  of  tasks  in  queue,  but  not 
their  dynamic  attributes.  A  quantity  not  modelled  previously  but  of  particular 
interest  is  the  lead-time  profile  of  the  set  of  tasks  in  queue.  One  can  model  these 
lead  times  as  points  on  the  real  line,  and  the  whole  lead-time  profile  becomes  a 
counting  measure.  Under  the  heavy  traffic  scaling,  when  the  earliest-deadline- 
first  service  protocol  is  used,  this  lead-time  profile  measure  converges  to  a 
limit,  whose  dynamic  properties  were  obtained  in  (7).  An  analysis  when  the 
first-in-first-out  protocol  is  used  is  provided  by  (6). 

The  classical  Feynmann-Kac  formula  provides  a  characterization  of  solutions 
to  second  order  parabolic,  linear  partial  differential  equations  in  terms  of  dif¬ 
fusion  processes.  A  more  complicated  formula  yields  a  connection  between  a 
certain  class  of  differential  equations  and  controlled  Markov  processes.  This 
formula  is  restricted  to  “convex”  type  nonlinearities.  Slightly  more  general  the¬ 
ory  is  available  if  one  considers  stochastic  differential  games  instead  of  optimal 
control. 

An  exciting  new  direction  in  this  line  of  research  was  the  discovery  of  a  similar 
connection  between  backward-forward  stochastic  differential  equations  and  a 
more  general  class  of  quasi-linear  partial  differential  equations.  In  joint  work 
with  Cvitanic  and  Karatzas,  Soner  studied  the  backward-forward  stochastic 
differential  equations  with  constraints.  The  resultying  equation  is  a  quasi- 
variational  inequality.  This  connection  and  other  properties  were  studied  in 
(5). 

In  a  different  direction,  Jerrard  and  Soner  studied  the  asymptotic  behavior 
of  Ginzburg-Landau  systems.  Earlier  analytical  work  has  been  restricted  to 
scalar  equations.  In  (3)  and  (4),  new  techniques  in  analyzing  systems  have 
been  developed.  In  particular,  (3)  provides  a  rigorous  justification  of  vortex 
equations.  This  equation  is  the  gradient  flow  with  a  logarithmic  potential  and 
it  models  the  transient  behavior  of  vortices  in  a  superconducting  material  after 
it  is  subjected  to  a  high  applied  magnetic  field.  Publication  (4)  studies  the 
similar  situation  in  three  space  dimensions.  In  this  case,  singularities  are  no 
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longer  point  vortices  but  vortex  lines. 
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